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REMARKS 

The following remarks are made in reply to the Final Office Action mailed March 13, 
2006, in which claims 1, 3-9, 11-17, 19, and 20 were rejected. With this Response, claims 17 
and 20 have been amended. Claims 1, 3-9, 11-17, 19 and 20 remain pending in the 
application and are presented for reconsideration and allowance. 

Claim Rejections under 35 U.S.C. § 101 

Claims 17, 19 and 20 stand rejected under 35 U.S.C. §101, as allegedly being directed 
to non-statutory subject matter. The Office Action finds that independent claim 17 recites 
"essentially a series of steps to be performed on a computer and thereby manipulating an 
abstract ideal without any limitation to a practical application that produces a useful, 
concrete, and tangible result as required to fall within the statutory classes set forth in 35 
USC 101." The Office Action further finds that claims 19 and 20 are directed to further 
computational limitations, and therefore also do not fall within the statutory classes set forth 
in 35 USC 101. 

Independent claim 17 and dependent claim 20 have been amended to clarify that 
instructions for concurrently processing digital video frames and high resolution still images 
in burst mode are stored on a computer readable medium. Applicants respectfully submit that 
as amended, claims 17, 19, and 20 are directed to statutory subject matter. 

Although "functional descriptive material" (i.e., data structures and computer 
programs which impart functionality when employed as a computer component) is 
nonstatutory when claimed as descriptive material per se (see Warmerdam, 33 F.3d at 1360, 
31 USPQ2d at 1759), when functional descriptive material is recorded on some computer- 
readable medium it becomes structurally and functionally interrelated to the medium and will 
be statutory in most cases since use of technology permits the function of the descriptive 
material to be realized. Compared reLowry, 32 F.3d 1579, 1583-84, 32 USPQ2d 1031, 
1035 (Fed. Cir. 1994) (claim to data structure stored on a computer readable medium that 
increases computer efficiency held statutory) and Warmerdam, 33 F.3d at 1360-61, 31 
USPQ2d at 1759 (claim to computer having a specific data structure stored in memory held 
statutory product-by-process claim) with Warmerdam, 33 F.3d at 1361, 31 USPQ2d at 1760 
(claim to a data structure per se held nonstatutory). Applicants submit the claimed computer 
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readable medium is a computer element which defines structural and functional 
interrelationships between the computer program and the rest of the computer which permit 
the computer program's functionality to be realized, and is thus statutory. Accordingly, 
withdrawal of the rejection of claims 17, 19 and 20 under 35 U.S.C. §101 is respectfully 
requested. 

Claim Rejections under 35 U.S.C, § 103 

Claims 1, 3, 4, 6, 8, 9, 11, 12, 14, 15, 17, 19 and 20 stand rejected under 35 U.S.C. 
§ 103(a) as being unpatentable over Wyman of record (U.S. 2003/01 12347) in view of Voss et 
al. of record (U.S. 2003/0147640) and Ueno et al. of record (U.S. Patent No. 5,436,665). 

The Office Action alleges Wyman discloses a method and apparatus for producing 
still video images using an electronic motion video apparatus as shown in Figures 1-3, and 
substantially the same: method for concurrently processing digital video frames and high 
resolution still images in burst mode, as presented in independent claim 1 ; joint video and 
still image pipeline for a video camera system, as presented in independent claim 9; and 
computer readable medium providing instructions for concurrently processing digital video 
frames and high resolution still images in burst mode, as presented in independent claim 1 7 
(referencing page 1, sections [0007], [0008], and page 3, section [0028]). In particular, 
Wyman is alleged to disclose substantially the same one or more image sensors (i.e., 103 of 
Fig. 2) capable of concurrently acquiring regular sized video frames and high resolution still 
image frames (referencing page 3, section [0028]); a sensor controller capable of storing the 
regular sized video frames and the high resolution still image frame into a memory 
(referencing page 3, section [0028], page 7, section [0059], and 204 of Fig. 2); one or more 
processors (referencing page 3, section [0028], and Fig. 2) capable of concurrently processing 
the reduced size video frames and high resolution still image frames acquired, wherein the 
reduced size video frames are processed using a video pipeline and the high resolution still 
image frames are processed using a high resolution still image pipeline, and wherein the high 
resolution still image frames are processed concurrently with the reduced size video frames, 
wherein the processing the high resolution still image frames includes processing the high 
resolution still image frames in real time (i.e., the continuous saving of video on a motion 
video medium in Wyman is alleged to represent real time processing of the high resolution 
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image frames, referencing page 1, section [008]); compressing the reduced sized video 
frames and the high resolution still image frames (referencing page 5, section [0042]); and 
wherein the processors are selected from a microprocessor, and application specific 
integrated circuit (ASIC), a digital signal processor (i.e., 201 of Fig. 2); and downsampling 
the high resolution still image frames, wherein the downsampled still image frames have the 
same frame sizes as the upsampled video frames (i.e., the full resolution 3M pixel viewable 
frame is allegedly converted to a low resolution motion video frame of the same size, 
referencing page 3, section [0003]). 

Wyman is acknowledged as failing to disclose: 

(a) concurrently processing digital video frames and high resolution still images 
in burst mode, concurrently acquiring regular size video frames and high 
resolution still image frames in burst mode, and storing the regular size video 
frames and the high resolution still image frames acquired during the burst 
mode into a memory as claimed in claims 1, 9, and 17; 

(b) wherein the regular sized video frames are downsampled into reduced sized 
video frames, the reduced sized video frames having frame sizes smaller than 
the regular size video frames as claimed in claims 1, 9, and 17; and 

(c) upsampling the reduced video frames using motion estimation and information 
from the high resolution still image frames, wherein blocks in the 
downsampled still image frames form a block pool; and comparing blocks in 
the block pool with corresponding blocks in the upsampled video frames until 
a best match is found, and copying the best match block into the 
corresponding blockcs in the upsampled video frames as claimed in claims 1 , 
3,4, 9, 11, 12, 17, 19 and 20. 

Regarding item (a) above, Voss et al. is alleged to disclose a system and method for 
capturing and embedding high resolution still image data into a video data stream 
(referencing Figs. 1, 2a, 2b, and 4) and is alleged to teach the conventional processing and 
acquiring digital video frames/regular sized video frames and high resolution still image 
frames in burst mode, and storing the regular sized video frames and the high resolution still 
image frames acquired during the burst mode into a memory (referencing page 2, sections 
[0022], [0024], page 3, section [0036], [0037], page 4, section [0039]). The Office Action 
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alleges one of ordinary skill in the art, having the Wyman and Voss et al. references at hand 
and the general knowledge of burst mode within digital still on video cameras, would have 
had no difficulty in providing the burst mode features in processing and storing video frames 
and high resolution still images concurrently as taught by Voss et al. for the joint video and 
still image pipeline system of Wyman for the same well-known capturing of high resolution 
still images while storing the video so that both the still image and the video images are 
captured concurrently without losing any information as claimed. 

Regarding items (b) and (c) above, Ueno et al. is alleged to disclose a motion picture 
coding apparatus as shown in Fig. 1, and allegedly teaches the conventional use of an 
upsampler 35 for upsampling reduced video frames using motion estimation (i.e., 104 of Fig. 
1) and information from high resolution still image frames (referencing Fig. 4), and 
downsampling regular size video frames into reduced sized video frames, wherein the 
reduced sized frames allegedly have frame sizes smaller than the regular sized video frames 
(referencing elements 29, 102 of Figure 1, Figures 2 and 3 A, and column 8, lines 28-45). 
Ueno et al. is further alleged to show substantially the same if not the same comparing blocks 
in the block pool (i.e., as input to 35 of Figure 1) with corresponding blocks in the upsampled 
video frames until a best match is found, and copying the best match block into the 
corresponding block in the upsampled video frames (i.e., as provided by the predictor 104 of 
Figures 1 and 4). Therefore, the Office Action alleges one of ordinary skill in the art, having 
the Wyman, Voss et al., and Ueno et al. references at hand and the general knowledge of 
video motion estimation, would have had no difficulty in providing the upsampling of 
reduced sized video frames using motion estimation and information from the high resolution 
still image frames, and downsampling of regular sized video frames into reduced sized 
frames wherein the reduced sized frames have frame sizes smaller than the regular sized 
video frames ,as allegedly taught by Ueno et al. as part of the video compression process 
within Wyman for the same well known compression of video for bandwidth reduction 
purposes as claimed. 

The rejection of independent claims 1, 9 and 17 is respectfully traversed. Referring to 
Section 706.02 (j) of the MPEP, to establish a prima facie case of obviousness, three basic 
criteria must be met: 
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(1) There must be some suggestion or motivation, either in the references 
themselves or in the knowledge generally available to one of ordinary skill in 
the art, to modify the reference to combine reference teachings; 

(2) There must be reasonable expectation of success; 

(3) The prior art reference (or references when combined) must teach or suggest 
all the claim limitations. 

The teaching or suggestion to make the claimed combination and the reasonable 
expectation of success must both be found in the prior art and not based on Appellant's 
disclosure. See In re Vaeck, 947 F.2d 488, 20 USPQ2d 1438 (F.E.D. Cir. 1991). 

Applicants respectfully submit that the combination of references cannot 
support a case of prima facie obviousness as to the claims because, among other possible 
reasons, there is no motivation to combine the reference teachings, and the combination 
of references fails to disclose all of the elements of the present invention. 

Applicant respectfully resubmits that there is no suggestion or motivation, either in 
the references themselves or in the knowledge generally available to one of ordinary skill in 
the art, to modify the reference to combine reference teachings, at least as to the combination 
of Wyman and Voss et al. At paragraph 9, the Office Action sets forth that the test for 
combining references is what the references as a whole would have suggested to one of 
ordinary skill in the art, and in the present case the combination of references as a whole 
renders obvious the claimed invention. Specifically, the Office Action states that though 
Wyman and Voss et al. may disclose various features that are diverse or different from the 
present invention, both references deal with the capture of still and video data an as such it is 
considered obvious to combine. Accordingly, the Office Action alleges the burst mode 
features in processing and storing video frames and high resolution still images concurrently 
as taught by Voss et al. may be certainly be provided for the joint video and still image 
pipeline system of Wyman, thereby providing the capturing of high resolution still images 
while storing the video so that both the still image and the video images are captured 
concurrently without losing any information as claimed. 

However, Applicant submits that the Examiner must consider additional factors when 
combining the references. In particular, if the proposed modification would render the 
prior art invention being modified unsatisfactory for its intended purpose, then there is 
no suggestion or motivation to make the proposed modification. In re Gordon, 733 F.2d 
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900, 221 USPQ 1125 (Fed. Cir. 1984). Further, if the proposed modification or 
combination of the prior art would change the principle of operation of the prior art 
invention being modified, then the teachings of the references are not sufficient to 
render the claims prima facie obvious. In re Ratti, 270 F.2d 810, 123 USPQ 349 (CCPA 
1959) (holding the "suggested combination of references would require a substantial 
reconstruction and redesign of the elements shown in [the primary reference] as well as a 
change in the basic principle under which the [primary reference] construction was designed 
to operate.") 

Wyman and Voss et al. use radically different methods for capturing high resolution 
still images, and Applicant submits that one skilled in the art would not attempt to combine 
the references as suggested in the Office Action. Wyman teaches the capture of motion video 
(at relatively low resolutions) on a motion video recording medium (such as magnetic tape 
110) while video frames at a higher resolution suitable for still images are concurrently 
captured and temporarily stored in a frame buffer 204. In the time interval before a frame in 
buffer 204 is overwritten by a more recent frame, a user may take some action to save the 
frame as a still image. (Para. [0028]). In contrast, Voss et al. teaches the suspension of 
normal video mode while still image data is captured and saved by a memory element. (Para. 
[00255]). One skilled in the art would have no motivation to provide Wyman with a 
burst mode feature as taught by Ross et al., as such a combination would require a 
substantial reconstruction and redesign of the elements of Wyman. Further, the 
suggested combination would render Wyman unsatisfactory for its intended purpose. 
For example, the frame buffer 204 of Wyman be rendered unnecessary or useless for its 
intended purpose. 

In addition, Applicant respectfully submits that Wyman, Voss et al., and Ueno et al., 
either alone or in combination, fail to teach or suggest all of the claim elements. Specifically, 
the references fail to teach or suggest at least the claim elements: "upsampling the reduced 
size video frames using motion estimation and information from the high resolution still 
image frames" (claim 1); "wherein the reduced size video frames are upsampled using 
motion estimation and information from the high resolution still image frames" (claim 9); 
and 4t upsampling the reduced size video frames using motion estimation and information 
from the high resolution still image frames" (claim 17). 
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The Office Action explicitly acknowledges that Wyman fails to disclose upsampling 
the reduced video frames using motion estimation and information from high resolution still 
image frames. (See Office Action, para. 6, page 4, item (c)). Voss et al. does not remedy the 
above-noted deficiency of Wyman. In particular, Voss et al. makes no teaching or suggestion 
regarding upsampling the reduced video frames using motion estimation and information 
from high resolution still image frames. The Office Action as much as acknowledges this 
position, as Voss et al. is cited as teaching concurrent processing of video frames and still 
image frames (item (a) in para. 6 of the Office Action), but is not cited as teaching either 
downsampling regular size video frames into reduced size video frames (item (b) in para. 6 of 
the Office Action), nor upsampling the reduced video frames using motion estimation and 
information from the high resolution still image frames (item (b) in para. 6 of the Office 
Action). 

Despite the assertions set forth in the Office Action, Ueno et al. also fails to remedy 
the above-noted deficiencies of Wyman and Voss et al. In particular, Ueno et al. relates 
solely to a motion picture (i.e., video) coding apparatus. There is no teaching, suggestion 
or discussion that the apparatus of Ueno et al. includes or is useful with high resolution still 
image frames. Applicant respectfully submits the Office Action is improperly equating 
the high resolution video frames of Ueno et al. with the claimed high resolution still 
image frames as set forth in the claims. Ueno et al. specifically states that the high- 
resolution video frames are supposed to be, for example MPEG-2. (Col. 9, lines -8). As is 
known in the art, MPEG-2 is for the generic coding of moving pictures and associated audio 
and creates a video stream out of three types of frame data (intra frames, forward predictive 
frames and bidirectional predicted frames). The video frames of Ueno et al. are not the same 
as the high resolution still image frames as set forth in the claims. Accordingly, Ueno et al. 
cannot be said to teach or suggest upsampling the reduced size video frames using motion 
estimation and information from high resolution still image frames as set forth in the 
claims. 

For at least these reasons, Wyman, Ross et al., and Ueno et al., alone or in 
combination, fail to teach or suggest all the claim limitations, and therefore fail to establish a 
prima facie case of obviousness. Accordingly, the rejection of amended independent claims 
1, 9 and 17 under 35 U.S.C. §103(a) should be withdrawn. 
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Claims 3, 4, 6, 8, 11, 12, 14, 15, 19 and 20 each depend, directly or indirectly, from 
one of amended independent claims 1, 9, or 17. For at least the reasons discussed above, 
independent claims 1, 9, and 17 are in allowable condition. Thus, dependent claims 3, 4, 6, 8, 
1 1, 12, 14, 15, 19 and 20 are also in allowable condition by reason of their dependency from 
claims 1, 9, and 17. Accordingly, withdrawal of the rejection of claims 3, 4, 6, 8, 1 1, 12, 14, 
15, 19 and 20 under 35 U.S.C. § 103(a) should be withdrawn. 

Claims 5 and 13 are rejected under 35 U.S.C. § 103(a) as being unpatentable over 
Wyman, Voss et al., and Ueno et al. as applied to claims 1, 3, 4, 6, 8, 9, 1 1, 12, 14, 15, 17, 19, 
and 20 above, and further in view of Adolph et al. (U.S. Patent No 6,081,295). 

Claims 5 and 13 depend directly from independent claims 1 and 9, respectively. For 
at least the reasons discussed above, independent claims 1 and 9 are not made obvious by 
Wyman, Voss et al., and Ueno et al., either alone or in combination, and are in allowable 
condition. Thus, dependent claims 5 and 13 are also in allowable condition at least by reason 
of their dependency from claims 1 and 9. Accordingly, withdrawal of the rejection of claims 
5 and 13 under 35 U.S.C. § 103(a) is respectfully requested. 

Claims 7 and 16 are rejected under 35 U.S.C. § 103(a) as being unpatentable over 
Wyman, Voss et al., and Ueno et al. as applied to claims 1, 3, 4, 6, 8, 9, 11, 12, 14, 15, 17, 19 
and 20 above, and further in view of Bittner et al. (U.S. Patent No. 6,330,400). 

Claims 7 and 1 6 depend directly from independent claims 1 and 9, respectively. For 
at least the reasons discussed above, independent claims 1 and 9 are not made obvious by 
Wyman, Voss et al., and Ueno et al., either alone or in combination, and are in allowable 
condition. Thus, dependent claims 7 and 1 6 are also in allowable condition at least by reason 
of their dependency from claims 1 and 9. Accordingly, withdrawal of the rejection of claims 
7 and 16 under 35 U.S.C. § 103(a) is respectfully requested. 
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CONCLUSION 

In view of the above, Applicant respectfully submits that pending claims 1, 3-9, 1 1- 
17, 19 and 20 are in form for allowance and are not taught or suggested by the cited 
references. Therefore, reconsideration and withdrawal of the rejections and allowance of 
claims 1, 3-9, 11-17, 19 and 20 is respectfully requested. 

The Examiner is invited to contact the Applicant's representative at the below-listed 
telephone numbers to facilitate prosecution of this application. 

Any inquiry regarding this Amendment and Response should be directed to either 
Denise L. Saffold at Telephone No. (650) 236-4868, Facsimile No. (650) 852-8063 or 
Matthew B. McNutt at Telephone No. (612) 767-2510, Facsimile No.(612) 573-2005. In 
addition, all correspondence should continue to be directed to the following address: 

Hewlett-Packard Company 

Intellectual Property Administration 
P.O. Box 272400 

Fort Collins, Colorado 80527-2400 

Respectfully submitted, 

Pere Obrador, 

By their attorneys, 

DICKE, BILLIG & CZAJA, PLLC 
Fifth Street Towers, Suite 2250 
100 South Fifth Street 
Minneapolis, MN 55402 
Telephone: (612) 573-2000 
Facsimile: (612) 573-2005 



Date: June 9. 2006 




MBM:dmd:ivh Matthew B. McNutt 




Reg. No. 39,766 
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Name: Matthew B. McNutt 
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